Skip to main content

On a convergent off -policy temporal difference learning algorithm in on-line learning environment

Iframe Pdf Item Preview

texts

On a convergent off -policy temporal difference learning algorithm in on-line learning environment

by
Prasenjit Karmakar; Rajkumar Maity; Shalabh Bhatnagar

Publication date
Usage
http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Topics
Computing Research Repository, Learning
Publisher
arXiv.org
Collection
arxiv; journals
Contributor
Internet Archive
In this paper we provide a rigorous convergence analysis of a "off"-policy temporal difference learning algorithm with linear function approximation and per time-step linear computational complexity in "online" learning environment. The algorithm considered here is TDC with importance weighting introduced by Maei et al. We support our theoretical results by providing suitable empirical results for standard off-policy counterexamples.

Notes

14 pages. arXiv admin note: text overlap with arXiv:1503.09105

Addeddate
2018-06-29 12:43:32
External-identifier
urn:arXiv:1605.06076[arXiv]
Identifier
arxiv-1605.06076
Scanner
Internet Archive Python library 1.7.0.dev2
Source
http://arxiv.org/abs/1605.06076

plus-circle Add Review
comment
Reviews

There are no reviews yet. Be the first one to write a review.

19 Views

DOWNLOAD OPTIONS

download 1 file
PDF download
download 1 file
TORRENT download
download 6 Files
download 6 Original
SHOW ALL

IN COLLECTIONS

Arxiv.org Journals

Uploaded by arkiver2 on

SIMILAR ITEMS (based on metadata)

Terms of Service (last updated 12/31/2014)